Diffusion Processes on Power-Law Small- World Networks 
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We consider diffusion processes on power-law small- world networks in different dimensions. In one 
dimension, we find a rich phase diagram, with different transient and recurrent phases, including 
a critical line with continuously varying exponents. The results were obtained using self-consistent 
perturbation theory and can also be understood in terms of a scaling theory, which provides a 
general framework for understanding processes on small- world networks with different distributions 
of long-range links. 
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Studying diffusion-related processes on networks, one 
can gain insight into synchronization 1] and spreading 
phenomena in natural, artificial, and social systems 0- 
In this Letter, we consider a class of models on small- 
wor Id (SW) networks with a power-law probability 
distribution of long-range links, where the probability of 
two nodes beingconnected goes as r~ a , with some ex- 
ponent a 0, 0- Such a structure can emerge in 
synchronization problems of distributed computing |8( 
where synchronization is achieved by introducing ran- 
dom communications between distant processors. Choos- 
ing a power-law SW network may be preferable, as it 
lowers the cost associated with communications. It was 
also recently argued |7| that "wiring-cost" considerations 
for spatially embedded networks, such as cortical net- 
works 9] or on-chip logic networks fl(3 ] , can generate such 
power-law-suppressed link-length distribution. A physi- 
cal example of such a power-law SW network arises in 
diffusion on a randomly folded polymer discussed below 

miia 

The addition of random long-range links to a regular 
rf-dimensional network, producing a SW network, leads 
in many cases to a crossover to mean-field-like behavior 
|l3j , effectively becoming equivalent to averaging over the 
long-range links in an annealed fashion. Here we focus on 
systems where it is not the case, and the contrast between 
the quenched and annealed systems is strong 0, ^| . We 
develop a perturbative method for the quenched network, 
which is asymptotically exact, as confirmed by numerics. 

Varying the exponent a, controlling the distribution 
of length of the links, the diffusive dynamics gives rise 
to a rich phase diagram, as the connection topology in- 
terpolates between the original "plain" SW (a=0) and 
the purely short-range connected (a=oo) network. The 
phase diagram can also be understood in terms of simple 
scaling ideas, showing that the breakdown of mean-field 
theory is associated with the relevance of the operator 
for scattering off a single link. 

Diffusion- Related Processes — We start with a d- 



dimensional lattice of linear size L and add long-range 
links, connecting two sites with a probability propor- 
tional to pr~ a , where r is the distance between the two 
sites, p is the probability of a site to have a random link, 
and a is the exponent of the decay, ranging from to 
oo. Although the original problem can have only one 
random link between two distant sites, the analytics are 
slightly simpler if pairs of sites may be connected with 
multiple links with a Poisson distribution of links; both 
cases have the same universal behavior in the small-p 
limit. Thus, in this work, we set the probability, that 
sites i and j are connected by n random links, equal to 

{p/m-inr e - v /{N\i-3n ^ where N = \j\-<*. 

One case in which the diffusion equation arises is a 
macromolecule randomly moving along a polymer chain 
jumping over adjacent segments with nonzero probability 
; if the macromolecule motion is fast compared to re- 
arrangements of the links, then the network may be con- 
sidered as quenched , while if the macromolecule 
motion is slow compared to the link rearrangements then 
the network is annealed flUH^ ]. The equation describing 
random walk processes is 

r" 

where P r '(t) is the probability of finding the walker at 
site r' at time t, — A r / r /< is the discretized version of 
the d-dimensional diffusion (or Laplace) operator, and 
— A^7, is the diffusion operator on the random links 
with diffusion coefficient q i.e. in one dimension A^- = 
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• Jij , where 



Jij = n if there are n links connecting sites i and j. The 
Green's function, G T > <r //(t), of this model is the solution 
of the equation with initial condition P r >(t = 0) = <5 r '. r ". 
Because the net probability has to be conserved dur- 
ing the process, the transition matrix has a zero eigen- 
mode so the matrix is invertible only in the subspace 
orthogonal to this mode. Consequently, the limiting case 
of the temporally Fourier-transformed Green's function, 
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lim^o (iw + A + qA 



')/«) is only invert- 
in the context of the 



ible in the same subspace. G r 
random walk, is related to the return probability and 
its scaling behavior with L will determine whether the 
walk is transient or recurrent. Earlier numerical work 
5] for d—1 suggested a as 2 as a crossover point from 
the transient to the recurrent phase. Here we compute 
the scaling properties of the propagator analytically (and 
confirm it numerically), and precisely construct the full 
phase diagram for all d. 

The second case, relevant to synchronization problems 
on SW networks in a noisy environment, is the Edwards- 
Wilkinson process E3 
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rnd 
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h r „(t)+ Vr ,(t), (2) 



where h is the surface height and 77 is a delta-correlated 
Gaussian white noise with variance 2. In this case, the 
Green's function is the steady-state two-point correlation 
function between h r i and h r ", so G r /y — (h r >h T ») = 
(A + qA rnd )~ r „, and again, the function is defined in 
the space orthogonal to the uniform zero mode. In the 
context of the Edwards- Wilkinson equation, G r ' r > is the 
measure of the surface roughness or width [14j. 

Ultimately, we are interested in the average of these 
quantities over all realizations of the networks. This av- 
eraging (denoted by [ ]) restores translation invariance 
for [G r i y] and therefore its spatial behavior will depend 
only on the difference r" — r'. Hence, we define 



G(r) = [(A + qA 



\ r' ,r'+r 3 



(3) 



where r is the spatial separation of the two sites. We 
expect that when the probability of the random links 
decays rapidly enough (a— >oo), the large scale behavior 
of the system is not affected by these links. When the 
probability of the random links decays slowly (a— >0) , the 
results of the original SW network should be recovered 
In between, there is a transition which is the focus 
of this Letter. Our starting point is an annealed cal- 
culation that turns out to be the first order result of a 
naive perturbation expansion for the quenched system. 
For small p this expansion breaks down and we apply a 
self-consistent calculation. 

Annealed Calculation — First, we consider the an- 
nealed predictions. In this calculation, to approximate 
the behavior of G(r), the random links are replaced 
with their expected number, i.e. the random interac- 
tions are annealed 0, [lj El E3 That is, in ©, 
A rnd is substituted with [A rnd ]. [A™ d ] r , r = p, and 
[A rnd ] riT i = ^ |r-r'|° f° r r ^ r '' Because of its transla- 
tional invariance, this operator is diagonal in Fourier- 
space, likewise A. In the large system-size limit, its 
eigenvalues in Fourier basis are: [A" ld ](k) oc p for 
< a < d; [A" ld ](k) tx pk a ~ d for d < a < d + 2; 
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Self-consistent perturbative results: 
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FIG. 1: Phase diagram for one dimension. Results from the 
annealed calculation (top) and from the self-consistent per- 
turbative calculation for the quenched case (bottom) showing 
different behavior in the transient/smooth phases (t./s. ph.) 
and in the recurrent /rough (r./r.) ones. 



and [A" ld ](k) cx pk 2 + ... for d + 2 < a. Hence, G(r) can 
be obtained by inverse Fourier-transformation and 



G(0) 



Td ^2 



L d £^ Q k 2 + q [A rnd ]{k) 



(4) 



To calculate the scaling properties of this quantity, with 
respect to p, q, and L, the sum can be approximated with 
its integral- form limit. The results for one dimension are 
sketched in Fig. ^ (top). For a < 2, the integral (QJ 
converges at both ends, so is system size independent for 
large L and diverges as p — > 0. There are two regimes, 
distinguished by their scaling behavior (reflecting the 
properties of the underlying random walk/surface) : (1) 
transient/smooth phase I, where the system behaves as if 
the long range links were uniformly distributed, and G(0) 
is a-independent; (2) transient/smooth phase II, where 
G(0) is still finite in the thermodynamic limit, but has an 
a-dependent divergence as p — » 0. For a > 2, G(0) has 
an infrared divergence resulting in two system-size de- 
pendent regimes: (1) recurrent/rough phase I, where the 
system behaves as if there were no long range links, and 
G(0) diverges linearly with the system-size, L; (2) recur- 
rent/rough phase II, with sublinear scaling with respect 
to the system-size. At the boundaries of these phases, 
logarithmic corrections are present. 

Self- consistent Perturbative Calculation for the 
Quenched Network — Following |l4|. we calcu- 
late G(0) perturbatively, treating A rnd as a weak 
scattering potential. Expanding Eq.@, G = 
G° - G°[qA rnd ]G° + G°[qA rnd G a qA rnd ]G° where 
G° = A -1 , the Green's function with no random interac- 
tions introduced. Rearranging the formula, one obtains 
the Dyson equation, G = G° - G°EG = (A + E)" 1 , 
where E = q[A rnd ] - q 2 [A rnd GA rnd ] c + ... is 
the self-energy and ] c represents the cumu- 
lants of the random variables A™ r j, for example 
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and so on. 



[A^A™^ = [Ay™ ^ kl J - L ^ ;j JL ^ kl 

Solving the equation to first order, E = q[A rnd ], the 
annealed result is recovered. Substituting this first-order 
result into the next order term of E, -q 2 [A rnd GA rnd ] c , 
it can be shown that the correction becomes domi- 
nant over the first-order term as p — > 0, and so the 
perturbation expansion breaks down. 

To have an operative perturbation expansion, as a first 
step E has to be calculated involving all the scatterings 
from a single link, then corrections representing scatter- 
ings from multiple links may be successively obtained. 
The closed form of E for the single- link problem is 



1(T 



E si (r ?0) = -q 



P 



Afr a 1 + 2g(G(0) - G(r)) 



(5) 



and E s '(0) = -E r #o ssi ( r )- Since G and ^ are cou- 
pled, they have to be solved for self- consistently. To do 
this, we make an ansatzfor E si , namely, in Fourier-space, 
E si (fc) = sfc M for small k-s, s and fi to be determined. 
Using this form of E si , the Green's function, in Fourier 
space, becomes G(k) = (k 2 + sk>*)~ 1 . Its long-distance 
real-space behavior, as in the annealed case, can be cal- 
culated with the integral-form limit of the expressions 
and E si should be treated similarly. 

For one dimension, as p — > at non-vanishing q, one 
finds several cases. For a < 1, fi = 0, s = p 2 , G(0) oc p^ 1 . 
For 1 < a < 2, fj, = a - l,s = p^,G(0) oc 
For a > 2, fi = a, s = p, G(0) oc L, while for a=2, /j, 
is given by the solution of the self-consistent formula: 
s^/^rxi-^) ~ ^' 1 < M<2- The leading order results 
are sketched in Fig. ^ (bottom). Similar phases appear 
as were predicted by the annealed argument, but in tran- 
sient/smooth phase II, we have a different scaling prop- 
erty, while recurrent/rough phase I spans a wider interval 
of the a-axis. Finally, recurrent /rough phase II is col- 
lapsed to one point on this axis, and in this phase, the 
sublinear behavior of G(0) is no longer determined by the 
distance-distribution of the random links but rather by 
their density, p, through the self-consistent formula. The 
form of this equation is approximate, but the fact that 
the exponent /j, depends continuously on p is likely to be 
correct, in light of the scaling arguments below. 

Scaling — These results for the quenched network can 
be understood via a simple scaling argument. The 
Green's function has dimension l 2 ~ d , where I is some 
length scale, as can be seen by considering the Green's 
function G°(r) = j d d kexp(ikr)/k 2 . The dimension of q 
is l d ~ 2 , as qG is dimensionless. 

The dimension of p is l~ d for a < d and l a ~ 2d for 
a > d. This arises from perturbation theory, but can 
also be understood geometrically: the probability that a 
block of linear size I has a long-range link with a length 
at least / is pl d for a < d and pl 2d ~ a for a > d. Thus, at 
a length scale I, for a > d, the important dimensionless 
quantities are: q = ql 2 ~ d , p = pl 2d ~ a , and Q = ojI 2 . 
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FIG. 2: Finite-size propagators G(0) vs. p for q=1.4, q=l 
(transient /smooth phase II) for various system sizes. Solid 
symbols represent data obtained by exact numerical diag- 
onalization averaged over 100 realizations for the quenched 
network. The solid straight line represents the slope obtained 
from the perturbative analytic calculations in the L^oo limit. 
Open symbols correspond to the steady-state averaged prop- 
agator on the annealed network with the straight dashed line 
being the mean-field analytic result in the L-^oo limit. 



There are several cases in the limit of small p and non- 
vanishing q. If 2d < a, then p scales to zero, and there 
are no links at large length scales; the system looks like 
a network without long-range links, giving G(0) oc L as 
in recurrent /rough phase I. 

If instead 2d > a > d, then at some scale I oc 



-i/(2d-a) ) {- ne density of long-range links becomes of 
order unity. This case breaks into two further subcases. 
If d < 2, then q is relevant; if p is small and q is non- 
vanishing, then higher order corrections will cut off the 
growth in q, so q at scale I will be of order unity, and 
will be independent of q at lattice scale. This tells us 
that the only meaningful dimensional number is p (since 
q is not important at this scale), and dimensional anal- 
ysis gives G(0) oc p-( 2 - d )/( 2d - a ) as j n transient/smooth 
phase II. This is a case in which mean-field theory breaks 
down because there is typically only one link at the scale 
I oc p _1 /( 2d ~ Q ) and the scattering off links is strong. If 
instead d > 2, then q decreases with increasing I, and 
at / oc p- 1 /( 2d ~ a ) the system has a high density of weak 
links where mean-field theory is valid. Near d = 2, an e- 
expansion is available |17| to compute higher corrections 
and determine prefactors in G(0). Finally, for a = 2d, p 
is marginal, giving the continuously varying exponent of 
recurrent/rough phase II. 

In the annealed case, one has a single number pq, 
and the corresponding dimensionless coupling constant 
is pq = pql d+2 ~ a . This becomes relevant for a < d + 2, 
and, e.g., yields the scaling G(0) oc (pg)^( 2 ^ rf )/( d + 2 ^ Q ) in 
the transient/smooth phase II. 

Numerical Results — For the annealed case, we numer- 
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FIG. 3: G(0) vs the system size L (all data for q—1) from 
exact numerical diagonalization. Data in the recurrent/rough 
phase I (o symbols) indicate the linear scaling with L (data 
is shifted up for clarity). Filled symbols represent the scal- 
ing behavior in the recurrent /rough phase II (a=2) for vari- 
ous values of p, indicating the p-dependence of the exponent. 
The solid lines, representing the slopes obtained from the self- 
consistent formula for the same set of values of p, show signif- 
icant deviations from the corresponding data for larger values 
of p. Data in the transient/smooth phase II (□ symbols), in- 
dicating a finite G(0) in the L—><x limit, are also shown for 
comparison. 



ically integrated Eq. (0) where the underlying power-law 
SW network was also reconfigured at every timestep, and 
measured the width G(0) in the steady state. The results 
in Fig.[21indicate that the mean-field approximation is ex- 
act for the annealed system. For the quenched case, we 
compared our analytic results to those obtained from ex- 
act numerical diagonalization of the discretized Laplacian 
for representative points in the phase diagram. In Fig. [21 
we show the main features of transient /smooth phase II 
(a=lA). For a region of p values, good agreement be- 
tween the two results can be observed. For finite systems 
of size L, the crossover in G(0) (see below) occurs when 
p < p x oc L a ~ 2 . For large values of p, deviation can be 
observed due to possible higher order corrections in p. In 
Fig. |21 we show the i-dependence of G(0) in the recur- 
rent/rough phases. While in the recurrent/rough phase 
I it diverges as G(0) oc L, in the somewhat "degenerate" 
recurrent/rough phase II (collapsed onto a single point, 
a=2) the exponent of the divergence depends continu- 
ously on p, G(0) oc LWp)-!. Although the self-consistent 
formula (solved numerically) predicts this latter feature 
qualitatively, the actual exponent appears to be affected 
by higher order corrections. 

Crossovers — There are two competing terms deter- 
mining the large scale behavior of the Green's function, 
the diffusion through the regular links, A, and through 
the random ones, A r . For small system sizes, the num- 



ber of the random links is small, their contribution to 
the ensemble average is negligible, the behavior is close 
to that of a d-dimensional unperturbed system. The ef- 
fect of the random interactions takes over when the self- 
energy generated by these random links start to dominate 
the infrared behavior of G(fc), which is when k\ ss T,(k x ). 
Thus, for the quenched case, in the transient/smooth 
phase II in one dimension, for L <C L x = k x oc p 2 - a , 

G(0) oc L; for L > L X) G(0) oc p^ . For the an- 
nealed system, the corresponding crossover occurs at 
L x (xp3=° , leading to G(0) oc for L 3> L x . 

Discussion — We investigated diffusion related pro- 
cesses on SW networks with distance dependent distri- 
bution of the random links. The results are summarized 
in the phase diagram of Fig. 1, with dramatically differ- 
ent behavior between the quenched and annealed case. 
The results for the quenched network can be understood 
via simple scaling arguments, based on the probability of 
finding links at a given length scale. We expect that these 
scaling arguments can be generalized to systems with an 
arbitrary probability p(r) of having long-range links and 
thus will be applicable to a wide-range of networks in 
which mean-field theory breaks down. 
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